#long context transformer'

'AI2 releases Olmo 3, an open 7B and 32B LLM family built on the Dolma 3 data suite with a 65,536 token context and fully transparent training pipeline. Variants include reasoning, instruction-following, and RL-ready models for reproducible research.'